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IN THIS EXPERIMENT* 166 FRESHMAN ENGINEERING STUDENTS 
STUDIED ELEMENTARY PROBABILITY BY THESE INSTRUCTIONAL 
METHODS— (1) MULTIPLE CHOICE TEACHING MACHINES* (2) 
FREE-RESPONSE TEACHING MACHINES IN INDIVIDUAL BOOTHS AND IN 
CLASSROOMS* (3) PROGRAMED TEXTS REQUIRING OVERT RESPONSES AND 
GIVING CORRECT ANSWERS* (4) PROGRAMED TEXTS REQUIRING NO 
OVERT RESPONSES* (5) "PROGRAMED" LECTURERS AND (C) STANDARD 
LECTURERS. THE STUDENTS FIRST TOOK AN ENGINEERING APTITUDE 
TEST* ON WHOSE BASIS THEY WERE RANKED AND THEN RANDOMLY 
ASSIGNED TO GROUPS. THEY WERE TESTED FOR LEARNING IMMEDIATELY 
AFTER INSTRUCTION. RESULTS INDICATED NO SIGNIFICANT 
DIFFERENCE IN STUDENT LEARNING BY ANY OF THE PROGRAMED 
METHODS* BUT ALL OF THE PROGRAMED METHODS WERE SIGNIFICANTLY 
MORE EFFECTIVE THAN THE STANDARD LECTURE. LEARNING TIME WAS 
SIGNIFICANTLY DIFFERENT FOR THE VARIOUS METHODS. MACHINE 
METHODS REQUIRING MOST TIME AND LECTURE METHODS LEAST TIME. 
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ABSTRACT 



Evidence , not all of which supports the application of the 
reinforcement theory of learning to simple auto* instructional or machine 
devices using linear programs, is provided by an experiment wherein 186 
.freshmen engineering students studied elementary probability by differeht 
teaching methods. Multiple-choice teaching machines, free-response teach- 
ing machines in individual booths, free-response teaching machines in a 
classroom, programmed textbooks requiring overt responses and providing 
" correct” answers, programmed textbooks requiring no overt responses, 

"programmed” lecturers, and standard lecturers are compared. The results 
indicate that there is no significant difference between the performance 
of the students learning by any of the programmed machine, programmed 
textbook, or programmed lecturer methods, and all of the programmed 
, methods are significantly better than the standard lecture. The time 
required for learning is significantly different for the various methods 
—the longest time being required by the machine methods and the shortest 
time by the lecture methods. 

I. INTRODUCTION 

The Automated Learning Research Project in the Department of En- 
gineering, University of California, Los Angeles, is directed toward the in- 
vestigation of the basic properties of auto-instructional systems. The aims of 
the project are: 

A. To provide a comprehensive model of the generalized automated 
teaching system. 

B. To express this model in mathematical terms. 

C. To determine the magnitude of the constants in such a mathe- 
matical expression. 

D. To determine a method for evaluating some of the variables of 

current interest. 

• 

1. Mode of presentation 

2. Rate of presentation 

3. Sequence of presentation 

4. Type of information 



5, Device complexity 

6, Programming effort 

7, Level of learning 

E. To explore the computer functions in an automated teaching 
system. 

F. To develop mathematical and experimental techniques for 
treating learning as a self-organizing system. 

The research program was divided into a number of phases. The 
primary goal of phase I was to develop a top quality teaching program for use 
as a test vehicle in obtaining data from subsequent experiments. As part of 
this phase , a pilot study was conducted during May 1960 in which 51 freshmen 
engineering students were taught the elements of probability by various auto- 
instructional and lecture techniques. The pilot study provided a check on the 
comprehensibility, reliability, and validity of the programmed instructional 
material, the screening tests, the criterion tests and the subjective question- 
naires used during the subsequent experiment. Also, experimental control 
srnd computational techniques were developed during the pilot study. Assump- 
tions on normality and homogeneity of variances were verified at this time. 
Some of the results of the pilot study are mentioned in Section III of this re- 
port. Complete details of the pilot study are available in: 

Report No. 60-53 

A Pilot Study- Automated Learning Research Project 

Department of Engineering 

University of California, Los Angeles 

II. EXPERIMENT OBJECTIVES 

A. To test the hypotheses that the mean performance of students* 
(as measured by criterion test scores) are equal if the students 
are taught by the following methods: 

1. All teaching methods: *MCM vs. FRMC vs.FRMB vs. 

PTRvs. PTNR'vs. T x vs. Tg vs. T g 

$ 

See footnote on following page. 
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2. Classroom vs. Booth environment: FRMC vs. FRMB 

3. Multiple -choice vs. Free response: MCM vs. (FRMC 
& FRMB) 



4. Overt responses vs. No overt responses: PTR vs. 
PTNR 

5. Machines vs. Programmed textbooks: (MCM & FRMC 
& FRMB) vs. (PTR & PTNR) 

6. Different programmed lecturers: vs. Tg 

7. Auto Tins t ruction vs. Programmed lectures: (MCM & 
FRMC & FRMB & PTR & PTNR) vs. (Tj & T g ) 

8. Programmed lectures vs. Standard lecture: (T 1 & Tg) 
vs. T 3 

9. Auto-instruction vs. Standard lecture: (MCM & FRMC 
& FRMB & PTR & PTNR) vs. Tg 



B. 



* 

* 



To test the hypotheses that the mean performances of students 
(as measured by criterion test scores) are equal if compared ac- 
cording to the following aptitude quarters: 

1. All aptitude quarters: vs. Qg vs. Qg vs. 

2. Q x vs. Q 2 



I 3 * % vs - % 

> 4. Q 3 vs. Q 4 

| ]|( 

MCM: Multiple choice teaching machine 

FRMC: Free-response teaching machines in a classroom 

l FRMB: Free-response teaching machines in individual booths 

PTR: Programmed textbooks requiring overt responses 

PTNR: Programmed textbooks requiring no overt responses 

T^: Programmed lecturer 

| Tg! Programmed lecturer 

T,: Standard lecturer 

3 

** 

l Aptitude quarters based on Lower Division Engineering Examination (LDEE). 

I Q is low-scoring quarter, Q 4 is high-scoring quarter.. 
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To test the hypotheses that the mean performances of students 
(as measured by criterion test scores) are equal if compared 
according to teaching - athods and aptitudes (interactions) as 
follows: 

1. All teaching methods and four quarters 

2. Machines vs. Programmed textbooks and four quarters 

3. Auto -instruction vs. Programmed lectures and four 
quarters 

4. Programmed lectures vs* Standard lectures and four 
quarters 

5. Auto-instruction vs. Standard lecture and four quarters 

To test the hypotheses that the mean learning times of students 
are equal if the students are taught by the following methods: 

1. All teaching methods: MCM vs. FRMC vs. FRMB vs. 

PTR vs. PTNR vs. T- vs. T g vs. Tg 

2. Classroom vs. Booth environment: FRMC vs* FRMB 

3. Overt responses vs. No overt responses: PTR vs. PTNR 

4. Multiple -choice vs. Free response: MCM vs. FRMC 

5. Multiple -choice vs. Programmed textbook: MCM vs. PTR 

To test the hypotheses that the mean learning times of students 
are equal if compared according to the following aptitude quarters 

1. All aptitude quarters: vs. Q 2 vs. vs. 

2. Q x vs. Q 2 

3. Q 2 vs. Q 3 

4. Q 3 vs. Q 4 

To test the hypotheses that the mean learning times of students 






^ wr*. ***4*4*0*? V^«-*' , *‘ iH 



are equal if compared according to teaching methods and 
aptitudes (interactions), 

G. To find the linear relationships between the variables: LDEE, 
criterion test scores, learning time, criterion test time, and 
student "liking” the teaching method. 



III. DESCRIPTION OF EXPERIMENT 
SUBJECTS 
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The pilot study had indicated that a sample size greater than 150 stu- 
dents would be required to give a powerful test of the hypotheses. Therefore, 
all 196 students enrolled in the seven sections of the Freshman Engineering 
Laboratory Course at the University of California at Los Angeles participated 
in this experiment. The students in the Freshman Engineering Laboratory 
Course were selected for this experiment because: 

1. They had previously taken the Lower Division Engineering 
Examination (LDEE), an aptitude-type test, the results of 
which could be used to divide the students into aptitude quarters. 

2. The pilot study had indicated that there was little or no previous 
knowledge among freshmen students of the sul ject matter which 
would be taught in the experiment, and also that there was very 
little correlation between such previous knowledge as did exist 
and performance during the experiment. 

3. The subject matter which would be taught during the experiment 
was sufficiently similar to the material normally taught during 
the first weeks of this course that it could be incorporated into 
the normal requirements of the course. This was done to avoid 
the question of transferability of results from ad hoc experiments. 

MODES OF INSTRUCTION 

Two types of teaching machines, two types of programmed textbooks, 
and two types of lecturers were used. 



One of the machines used was a Skinner type Free Response Machine 
(FRM), a mechanical device for the controlled presentation of a carefully con- 
structed sequence of instructional items. (See Figure A-,1 for a description 
of the FRM. ) The other machine was an electromechanical Multiple Choice 
Machine (MCM) which automatically advances the sequence of instructional 
items after the student makes the "correct" choice from three alternatives. 

If a wrong choice is made, the machine scores the error on a cumulative coun- 
ter and marks the item. The student must then make the "correct" response 
to advance the instructional material to the next item. (See Figure A-3 for a 
description of the MCM. ) 

Both types of machines were available in prototype models only, and a 
number of operating difficulties were encountered during the pilot study. Most 
of these difficulties were eliminated by some minor modifications to the ma- 
chines, and by using a continuous paper feed located external to the machines, 
instead of fan-folded paper feed locked in the machines. As a result of these 
modifications the machines operated without any major mishaps during the ex- 
periment. 

During the pilot study, a delay in the delivery of some of the machines 
resulted in there being more students available than machines for them to work 
on (simultaneously). A cardboard masking device was hurriedly improvised 
which could be used with the same programmed instructional material as used 
in the FRM. (See Figures A-5 and A-6.) The results of the pilot-study indi- 
cated that students performed as well after receiving instruction with this non- 
mechanical device as after receiving instruction with the mechanical or electro- 
mechanical devices. This prompted the introduction of programmed textbooks 
into the current experiment. In using a programmed textbook, the student 
reads an item of instruction, writes his response next to the item, turns the- 
page to see the "correct" response, turns the page to see the next item, and 
so on. (See Figure A -7 for a description of the programmed text. ) These 
programmed texts (PTR) require an overt response by the student, and provide 
an immediate feedback to the student as to the correctness of his response. 
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Both features are consistent with the current theories for presenting auto- 
instructional material to students • Another, often quoted, feature of such 
auto -instructional material, is that the items of instruction be so ingeniously 
sequenced, and, generally, broken down into such small steps so that the stu- 
dents will respond correctly to 90 - 95% of the items. 

At this point, we conjectured that if the auto-instructional material 
was indeed contrived to insure 90 - 95% correct responses, then perhaps the 
overall learning of the students might not be seriously impaired by the absence 
of feedback to the student about the correct answer. We therefore introduced 
another type of programmed text (PTNR) which required no overt responses 
and provided no ’’reinforcement” of the correct answer, other than the state- 
ments in each item. (See Figure A -8 for a description of the PTNR. ) 

During the pilot study, we had two groups of students, each taught by a 
different instructor. These groups were to have served as controls for com- 
paring auto mat ed instruction against ’’normal” instruction. The results indi- 
cated that students who had the ’’normal” instruction performed as well as stu- 
dents who had received the programmed instruction. However, a review of thf 
tape recordings made during the ’’normal” lecturers indicated that the lecturers 
were performing in anything but a ’’normal” manner. They were performing like 
’’programmed” lecturers. Indeed, both lecturers were so familiar with the 
closely ordered sequence of items developed for use with the automated devices, 
that they were actually trying to preserve the same method of presentation, 
merely translating the written statements of the programmed material into oral 
form. This was perhaps attributable to the conscious attempt which was made 
to keep subject matter content the same for all modes of instruction. The 
lecturers probably had difficulty in separating equality of subject matter content 
from equality of pedagogical technique. Therefore, in the current experiment, 
we used the same two instructors and called them Programmed Lecturers (T^ 
and T 0 ). In addition, we used a third instructor (who was not familiar with the 

a 

programmed sequence of instructional items) to teach a control group. This 
Standard Lecturer (T„) was given a topic outline (in this case, a group of prob- 

u 

ability formulas), an example of the kind of examination (criterion test) which 
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the students would have to take, and a number of marked reference books 
which covered the selected topics in detail. Two half-hour consultations were 
held with this Standard Lecturer to discuss the questions he had concerning the 
subject matter. 

INSTRUCTIONAL MATTER 

The instruction given the students was on elementary probability. The 
original sequence of 230 items was developed more or less in accordance with 
the concepts enumerated in: 

Roe, A. & Moon, H. , "Analysis of Course Content for Individual 
Learning", Automated Teaching Bulletin, Vol. 1, No. 3, Summer 1960. 



After the pilot study, an analysis of how students responded to each of 

| the items in the instructional sequence, and how they performed on the criterion 

l 

I test, resulted in modifications to the original sequence, and also elimination of 

i some instructional items which were irrelevant to the performance tested in the 

| 

| criterion test. The revised sequence contained 192 items. Identical items were 

| 

l used in the FRM and PTR. Identical items with the addition of two "wrong" 

I responses for each item were used in the MCM. Identical items, with the re- 

I sponse given in the item, were used in the PTNR. The programmed instructors 

I loosely followed the same sequence of items. (See Appendix B for samples 

I from each of the instructional materials. ) The intent was to cover the same 

&. * 

topics at the same level of difficulty and intensity in each one of the programmed 

I? 

l modes of instruction. 

[ ENVIRONM ENTS 

I* w— - ■ ■ ■■ — . I - « ■ ■ 1 

\ There were two machine environments. One was provided by five booths, 

especially built for machine use, in one room of the laboratory. The other was 
1 provided by three rows of large library tables in a separate, larger room. (See 

i 

l Figures A-9 and A- 10 for photographs of these two environments. ) 

I 

\ Students were convened in standard classrooms for study with the pro- 

l 

| grammed textbooks, and in other classrooms for hearing the programmed and 

I standard lectures. 
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PROCEDURES 



On the basis of scores on the Lower Division Engineering Examination 
required of all students before admission to the Department of Engineering, 
the students were divided into quarters (without their knowing it) and were 
then randomly assigned from each quarter to the various groups. 

A preliminary meeting was held with the instructors of the Freshman 
Engineering Laboratory sections to explain the nature and purpose of the ex- 
periment. They were asked not to mention the study to their students or dis- 
cuss anything related to it with them. 

The students were not informed that they were participating in an ex- 
periment, and since they were all new to the University, they could be expected 
to accept almost any teaching method without too much surprise. The experi- 
ment was conducted during the regular scheduled hours of the various class sec- 
tions* At a previous class meeting, each student had been given a card directing 
him to the appropriate lecture room or laboratory room. 

Upon arrival at the laboratory, each student was instructed to find his 
name on a place card taped on the table beside each device. Each name card 
bore the following information: 

The instructional device you will be using is intended to help 
you learn. You will not be scored or graded on your efforts 
on this device. However, you will be given a short quiz 
afterwards. So use your time with the device for learning. 

No further instructions were given. Proctors serviced the machines 
. when necessary, and if students asked questions about any item, the proctors 
were non-committal as to interpretation. Each student progressed through the 
programmed material at his own rate, and upon completion of the program was 
given a brief opinion questionnaire and the examination materials (see Appendix 
B-8, B-9, B-10) which he handed in after finishing the examination. 

In the lecture groups, the students were informed that they would be 
given a brief quiz at the end of the lecture and that they could take notes if they 
wished. The lectures were tape recorded. At the end of each lecture, these 



students were given a brief questionnaire and the examination materials. The 
students were not permitted to use their notes or scratch pad during the exam- 
inations. 

In all groups the examinations were identical, but the questionnaires 
were somewhat different for the automated learning and lecture groups. The 
questionnaire for the automated learning groups was intended to sample stu- 
dent evaluation of the automated method, materials and environment, and the 
questionnaire for the lecture groups dealt with evaluation of the instructor, the 
materials and environment. 

IV. RESULTS 

The results of this experiment are substantially the same as those 
obtained during the pilot study. An analysis of variance, comparing the cri- 
terion test scores of students who learned by the various methods of instruc- 
tion, failed to indicate any significant difference between the different methods, 
considered all together. (See Appendix C-3. ) 

When comparing pairs of teaching methods, we find no significant dif- 
ference in criterion test performance between those students who used the 
Free-Response Machines in the individual booth environment vs. those who 
used the same n. chines in a classroom environment. Nor is there a sig- 
nificant difference in performance between students who used the Free -Re- 
sponse Machines vs. those who used the Multiple Choice Machines. Like- 
wise, there is no indication that the programmed textbook with responses re- 
sults in a significantly better performance than the programmed textbook with- 
out responses. Also, machine methods do not result in significantly different 
criterion test performances than the programmed textbooks. However, the 
students who had the programmed lectures, and the students who used the 
programmed auto-instructional material in the machines and the textbooks, 
did perform significantly better than the students who had the standard lecture. 

While the various methods of presenting programmed material re- 
sulted in approximately equivalent performances by the students on the cri- 
terion test, the time that the students took in learning by the various methods 
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of instruction was significantly different. The lectures were delivered in con* 
siderably less time than the mean time taken by the students who paced them- 
selves on the machines and programmed texts. The students using those 
devices which did not require the composition of a written answer, namely, 
the Multiple Choice Machines and the Programmed Texts With No Responses , 
took significantly less time for learning than the students who used the Free 
Response Machines and the Programmed Texts With Responses. 

As expected, the students in the lower aptitude quarters did not score 
as high in the criterion tests as the students in the upper quarters, and also, 
the lower quarter students took longer to complete the learning task than 
the upper quarter students. However, there is no significant indication that 
any one of the teaching methods is better than another for students of a par- 
ticular aptitude quarter, either on the basis of criterion test performance 
or learning time. 

In examining the linear relationships between the variables (Appendix 
C-4) we find the amount of time the individual students took to complete the 
criterion test was not significantly correlated to the aptitude rating of the 
student, but the amount of time taken to complete the criterion test, did cor- 
relate significantly with the test scores. Contrasted to this is the result that 
the individuals with high aptitude scores took l^je time during the learning 
phase. Also, the less time the individual took during the learning phase, the 
more time was taken during the criterion test. 

The students’ subjective opinion about the various teaching methods, 
as indicated by the "liking" ratings, did not correlate either with their apti- 
tude nor with their performance on the criterion test. The divergent opin- 
ions of the students, as also shown in their comments (see Appendix F), in-s 
dicates that such subjective opinions are mediated by factors other than edu- 
cational aptitude or performance. 

The average percentage of incorrect responses made by students 
using the MCM and PTR (where records of errors were kept) was less than 









11%. This figure could be used, with some caution, in evaluating the dif- 
ficulty level (or adequacy) of the programmed teaching material. 

V. CONCLUSIONS 

For linearly programmed subject matter there appears to be little 
justification for preferring one mode of presentation over another, insofar 
as the effect on the level of student performance is concerned. It seems 
that the important variable is the program of instruction, and if this has been 
carefully conceived, then the particular method of presenting the program 
does not significantly influence the level of student performance. Some of the 
hardware currently being used to display programmed material may there- 
fore be unnecessary, particularly if it takes longer for a student to complete 
a given programmed course with the device than with a simple printed text- 
book version. 

We should also recognize that some machine features, such as anti- 
cheat mechanisms and the recording of particular items which are missed, 
do not necessarily enhance student learning, but rather are convenient fea- 
tures for the experimenter who wishes to evaluate student performance or 
particular items of the teaching program. If the emphasis is on using a 
more or less perfected program for student learning, then many of the 
machine features are unnecessary and may actually impede student learning. 
If the emphasis is on improving the program, then most machine devices 
currently employed could be improved upon to facilitate this task. If one 
wishes to simultaneously teach and to improve the program (and this may 
well be the direction in which future device capabilities will evolve) then 
some new thinking and relatively sophisticated hardware will be required 
(See Hoe, A. , Lyman, J., & Moon, H. , "The Dynamics of an Automated 
Teaching System", Automated Teachihg Bulletin, Vol. 1, No. 4, Winter I960.) 

We were not surprised to find that the difference between using mul- 
tiple-choice items vs. recall or free-response items (the subject of much 
previous dispute) and the difference between individual booth and .classroom 
environments, did not significantly affect student learning. 
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Perhaps the most significant discovery made during the experiment 
v/as that overt student responses , followed by immediate feedback on the 
"correct” response did not enhance student learning but merely increased 
the time necessary for performing the learning tasks. While the current 
concepts of programming material still depends very much upon "arranging 
appropriate contingencies of reinforcement" to ellicit specified student per- 
formance, some questions are now raised concerning the validity of the re- 
inforcement theory of learning, particularly as applied to B. F. Skinner's 
"appropriate teaching machine", (see Skinner, B.F., "Teaching Machines" 
Science, Vol. 128, No. 3330, October 24, 1958, pp. 969-977). 

While it would be imprudent to attempt to generalize from the results 
of this series of experiments to all types and levels of course material, and 
to all student ages and backgrounds, it appears that experimental data does 
not coincide with some of the currently publicized advantages of certain auto- 
instructional techniques, particularly as applied to linearly programmed mate- 
rial. This does not mean that proper programming of instructional material 
is not beneficial to the student. On the contrary, the program itself seems 
to be the important factor, and the method or device for displaying the pro- 
gram will depend on the economical and environmental circumstance that 
prevails in each particular case. 

Even when emphasizing the importance of the programmed material, 
we must exercise some caution. One student, who failed to read the instruc- 
tions at the beginning of the programmed textbook, read down the page in- 
stead of from page to page with the result that the sequence of items he saw 
were numbered: 1, 40, 79, 118, 157; 2, 41, 80, 119, 158; 3, 42, 81, 120, 159; and 
so on. TMs student still managed to get a high score on the criterion test. 

This "accident" leads us to ponder on the concepts used in sequencing in- 
structional items. 

In conclusion, we feel that present theories and auto-instructional 
techniques are inadequate to achieve the goals of effective individualized 
instruction, and that a workable automated teaching system will require fur- 
ther analytical and hardware development. 
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MULTIPLE CHOICE MACHINE (MCM). Learning items appear MULTIPLE CHOICE MACHINE, showing internal mechanism for 

under the large transparent window. Student responds by depres- automatic advancing of the programmed learning material, 
sing the small transparent windows covering the answer of his choice. 











mmi 
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SLIP (M. S. ) A non-mechanical device used presenting MASKING SLIP, improvised from cardboard file folders, during 
ed learning material to students during the pilot study. the pilot study. 
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FIGURE A- 9 
BOOTH ENVIRONMENT 




FIGURE A- 10 

CLASSROOM ENVIRONMENT. Bins under the tables are for storing 
rolls of program sheets and response tapes, which are fed continuously 
through the machines. Both Free Response Machines and Multiple 
Choice Machines were used in this classroom. 
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APPENDIX B 




1. FREE RESPONSE MACHINE PROGRAM SAMPLE 



(Learning Item*) 

122 So far you have studied about the probability of a single 
event, P {a} ; the probability of either one or another 
of two or more possible events, P 1 a or B> ; the prob- 
ability of joint events, P .|AB| ; and the probability of 
the union of events, P {AUb} ; that is, the probability 
of either A or B occurring wnen it is possible for 
? A and B to occur in the same trial. 



Correct Rtaponee, 
Concealed in FRM 
While Student Composes 
His Response 



both 



123 The probabilities were represented as some fractional 
value, generally obtainable by dividing n by N. The 
values of n and N are not always easy to find by simple 
counting procedures. Two computational methods used 
in finding the values of n and N are PERMUTATIONS and 
COMBINATIONS. The distinction between ? and 

combinations depends upon whether or not the things we permutations 

are interested in have distinguishable ORDERED ar- 
rangements. 



124 The first three letters of the alphabet can be arranged in 
six different orders, abc, acb, bac, bca, cab, cba. As 
you can see, each of the six sets of letters contains the 
same three letters but in a different ^arrangement. 



125 If the number of objects or events to be ordered is small, 
one can make all the possible ordered arrangements, as 
we did with the first three letters of the alphabet, and 
count them. However, if the number of objects is larger, 
it is more convenient to calculate the number of possible 
ordered arrangements. In the case of the first three 
letters of the alphabet, this is done by 3 x 2 x 1 = 6, 

which is the same ? of possible ordered arrange - 

ments we prepared in the preceding item. 



126 We calculated the number of possible ordered arrange- 
ments of the first three letters of the alphabet by 
3 X 2xl = 6. To illustrate why this method is used, let 
us use three balls, labelled A, B, and C, and a box 
divided into three cells. 

BOX 

_j 2 3_ ® (D © 

How many different balls can we choose from to fill cell 1? 



127 



jell 1 can be occupied by ball A, or B, or C. There are 
hen three different ways (balls) by which Cell 1 can be 
illed. If we fill Cell 1 in each of the three different ways, 
t can be filled 



© © 



®© 



®® 






© 



We can see that regardless of which of the three balls is 
chosen to fill Cell 1, when Cell 1 is filled, there are 
? balls left from which we can choose to fill Cell 2. 



two 



128 This illustration shows Cells 1 and 2 filled in all the pos- 
sible ways they can be filled. Cell 1 = 3 ways, Cell 2=2 




We can see in this illustration that there is only one way 
(ball) left to fill cell 3 when cells 1 and 2 are filled. Thus, 

there are 3x2x1= ways in which 3 balls can fill 

3 cells. 



6 



O 
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129 The first six letters of the alphabet can be arranged in 

6x5x4x3x2xl= 720 different ordered arrangements. 

Each ordered arrangement is called a PERMUTATION. permutations 

Therefore, there are 720 possible _? of the first six letters 

of the alphabet. 



130 A permutation is an ? arrangement. 


ordered 


131 In arranging the first 5 letters of the alphabet in all the 
possible permutations, there are: 

n = 5 possibilities for the first choice 
\ n - 1 = 4 for the second choice 
\ \ n - 2 = 3 for the third 
\ \ \ n - 3 = 2 for the fourth 

\ \ \ \ n - 4 * 1 for the fifth 

Permutations = (5) (4) (?) (2) (1) = 120 


3 


132 Now we can write the general equation for calculating the 
permutations of n things. Permutations * n(n-l)(n-l). . . 
(1). The row of dots indicates omission of intermediate 
values. The figure (1) at the end, indicates the end of 
the series of values, because any series of this sort 
always ends in 1. If there are 6 things to be ordered, 
then n = 6. 

Permutations = (6)(6-l){6-2)(6-3)(6-4)(6-5) 

= (6)(5) (4) (?) (?) (1). 


3.2 


133 If there are 8 things, n = 8. 

Permutations = (8)(7)(6)(5)(4)(3)(2)(1) 

= n(n-l) (?)(?) (1). 


n-2, n-3 


134 In multiplication, each of the numbers multiplied to- 
gether is called a factor. In Permutations = (6)(5)(4) 
(3)(2)(1), each of the numbers multiplied together is a 
factor. Likewise, in the formula for permutations, 

Permutations = n(n-l)(n-2) (1); n and each expres- 

sion inside parentheses is a ? 


factor 


135 The symbol n!, read "n -factorial", stands for the num- 
ber of factors which must be multiplied together to ob- 
tain the number of permutations of n events or objects. 

Thus, n! = n-factors = n(n-l)(n-2) (1). Therefore, 

the general formula for permutations of n things is 
easily written: Permutations * ? 

(Hint: n - factorial). 


n! 


\'M* n ! stands for the number of different ? of n ob- 

jects or n events. 


permutations 
or ordered arrangements 


' If there is a chair for each student, 5 students can be 
seated in n! = 5! = (5)(4)(3)(2)(1) = 120 different ways 
(permutations). The first four letters of the alphabet 
can be arranged in n! = ? = (4)(3)(2)(1) » 24 

permutations. 


4! 


* ^ = 8, n ! * 8 ! * ? . (Write the factors.) 


(8)(7)(6)(5)(4)(3)(2)(1) 
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. MULTIPLE CHOICE MACHINE PROGRAM SAMPLE 




122 So far you have studied about the probability of a single event, P {a} ; tha 
. probability of either one or another of two or more possible events, P 
(A or B) ; tha probability of joint events, P {Ab} ; and tha probabUity 
of the union of avanta, P {A U BJ , that la, the probability of either A or 
B occurring whan it la possible for ? A and B to occur in the eame 
trial. 

[either] [both] [neither] 



123 The probability a ware repreeented aa aome fractional value, generally ob- 
tainable by dividing n by N. Tha valuta of n and N are not alwaya auy to 
find by elmple counting procedurta. Two computational mathoda uaad in 
finding the value a of n and N are PERMUTATIONS and COMBINATIONS! 

Tha diatlnction between ? a nd comblnationa dependa upon whether or 
not the thing we are interested in ha* diatinguiahable ORDERED arrangemanta. 

[permutations] [probabilities] [computations] 



124 Tha firat 3 lettere of tha alphabet can be arranged in eix different ordere: 
abc, acb, bac, bee, cab, cba. Aa you caneaa, each of the eix sets of let- 
ters contains the same 3 letters but in a different arrangement. 

[ordered] [style of] [probable] 



125 If tha number of objects or avanta to be ordared is email, one can make all 
tha possible ordered arrangemanta, as wa did with tha firat 3 letters of tha 
alphabet, and count them. However, if tha number of objects ie larger, it 
is more convenient to calculate the number of possible ordared arrangemanta. 
In the case of the firat 3 letters of tha alphabet, this is done by 3 x 2 x 1 • $, 

which is tha same of posiible ordered arrangements wa prepared 

in the preceding item. 

[number] [atyia] [combination] 



12$ Wa calculated tha number of possible ordered arrangemanta of tha firat 3 
latte ra of tha alphabet by 3x2x1* 6. To Illustrate why this method is 
uasd. 1st us use thres halls labelled A. B, and C, and a box divided into 
three cells: aox $AUS 

I 11 I ® ® © 

I Z 3 



How many different balls canwa choose from to fill cell 1? 



M 



[3] 



(*) 



127 Cell 1 can b.» occupied by ball A, B or C. There are, then, 3 different ways 
(balls) by which ceil 1 can be filled. If we fUl cell 1 in each of the 3 dif- 
ferent ways it can be filled 



© 



M JD 



© 

ID 



n 



we can eee that regardless of which of the 3 balls ie chosen to fill cell 1, 
when cell 1 Is filled, there are ? b ails left from which wt can choose 
to fill csU 2? 



[3] 



M 



M 



121 This illustration shows cells 1 and 2 filled in all the possible ways thsy can 
be filled. Cell 1 • 3 weya, Ceil 2*2 ways. 

© © ® 
l¥T®i~) l©l©l 1 

HMD HMD 



HUE 






Ws can ••• in this illustration that there ie only one-way (ball) left to fill cell 

3, when cells 1 end 2 ere filled. Thus, there are 3 x 2 r 1 • _? ways in 

which 3 balls can fill 3 cells. 



[different] 



(«] 



[identical] 



129 The firat eix letters of the alphabet can be arranged In$x5x4x3x2xl* 
720 different ordered arrangements, Each ordered arrangement la called a 

PERMUTATION. Therefore, there ere 720 possible of the 

first $ latte- s of the alphabet. 



[permutations] 



[combinations] 



[identical groups] 



130 A permutation is an 



_sr range ment. 



[identical] 



[ordered] 



[ neither identical ] 
nor ordered J 






tfHMtMMS 
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131 In arranging the first S letter* of the alphabet in all the possible permuta- 
tion#, there are 

n ■ 5 possibilities for the first choice 
\ n*l ■ 4 for the second choice 
i-2-3 for the third 

n-3 * 2 for the fourth 
/V -4 » 1 for the fifth 
Permutations - (5) (4) (?) (2) (1) - 120 

[«-♦] (»1 (»-*] 



132 By what we have eeen we can write the general equation for calculating the 
permutations of n things. 

Permutations > n(n-l)(n-2)....(l) 

The row o', dots indicates omission of intermediate values. The figure (1) 
at the end indicates the end of the series of values, because any series of 
this sort always ends in 1. If there are I things to be ordered, then n • t. 




Permutations « (6)(n-l)(n-2)(n-3)(n-4)(n-5) 

- (6)(l-l)(6-2)(6-3)(6*4)(t*5) 

«(•) (5) (4) (?) (?) (1) 

(4, 3] [3, 2] [n-1, n-2] 



133 If there are n things, n « ft. 

Permutations • («)(7)(«)(5)(4)(3)(2)(1) 

■ n(n- 1) ( ? ) ( ? )...(1> 

(n-2, n-3] [n-3, n-4] [«, 5] 



134 In multiplication, each of the number# multiplied together is called a factor. 
In permutations • «)(5)(4)(3)(2)(1), each of the numbers multiplied together 
is a factor. Likewise, in the formula for permutations: permutations • n(n-l) 
(n-2). . . (1); n and each expression inside parentheses is a . 

[factor] [ multiple] [trinomial] 



135 The symbol nl, read V facto rial”, stands for the number of factors which 
must be multiplied together to obtain the number of permutations of n events 
or object*. Thus, n! ■ n-factors ■ n(n-l)(n*2)... .(1). Therefore, the 
general formula for permutations of n things is easily written: Permutations 
• ? (Hint: n-factorial. ) 

[n(n-l)(n-2)...(r)] [n(n-l)(n-2). . . (n) J [nl] 



136 n • strnda for the number of different 
[combinations] 



of n objects or n events. 

[permutations] [like orders] 



137 If there is a chair for each student, 5 students can be seated in n! ■ SI • 
(5)(4)(3)(2)(1) • 120 different ways (permutations). The first four letters of 
the alphabet can be arranged in n! • ? ( 4)(3)(3)(1) ■ 24 permutation*. 

[*l] [4l] [J4l] 



131 Ifn*5, n!«5!» ? 

(Identify the factors) 

[(5)(4)(3)(2)] [<5)<J)<4)(2)(1>] [<*)<4)<3)<3)<1)] 



131 In previous examples we arranged all the n things in the possible different nl 
permutations (orders). In the case of the first four letters of the alphabet, 
n«4; therefore, there were n» ■ ? permutations. (Identify the final ans- 

wer.) 

[*4] [10] [«] 



140 If all of n object# are taken at a time, the number of permutations » nl That 
is. If n objects are taken n at a time, permutations » nl If there are n objects 
and we want to know the possible permutations if we take less than n at a time, 
we say w# take n objects M r" at a time. Thus, V* is an arbitrary symbol 
standing for some number less than n. Jf w# have four objects and w# want to 
take them in pairs (2 at a time) n-4, and r - ? 
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SAMPLE FROM: PROGRAMMED TEXT WITH RESPONSES 



pi|t 11 












Would you bs certain or uncertain that tha hammar blow would not break 
the tough steal rod? 



44 



Let a trial be a single tose of a coin. There is only one head on a coin. 
Therefore, there is only one poeelble occurrence of heads . If A * heads, 
thus, in 



P W* ~N~ ‘ 



(ths number of possible occurrences of the event heads ). 






83 



In c aaaa Ilk* tltpping a coin or rollins a dla. r*plac*m*nt U not a probUrn. 
It ha* alr**d.v b**rt takvn car* of. Th. imad and tall r.maln on a ooln. ar»a 

all th* ulx number* on m dl* rn»n«ln on «!.• «**•- r „* rJl?”. m^ihinu 

i ,„ Ull i uun.lU.r wh«thnr u .* not that M«,m*i«nlr>M 
r.n« « h* n.at trial. 



all th* ula numb, 
uan be r.ntovatl in m trial 
Will ba 



122 



So far you have studied about the probability of a aingle event, p{a} ; the 
probability of either one or another of two or more possible events, 

P Ia or b}; the probability of joint events. p{ab|; and the probability 
of the union of events. PjAUB); that ia, the probability of either A or B 

occurring when it is possible for A and B to occur in the lime 

trial. 






t*«r mutation* - “fpyf'XT’l l 



In how many different permutations can the letters of the word PAPAL be 
arranged? (Note the kinds of letters and the number of each kind. ) 



paf» 1J 


5 


certain 

(that ths rod would 
not bs broksn) 


44 


1 


13 


122 


both 


161 


— -A! — * 30 
2! 2! 1! 







24 









I 



i 



% 



% 



l 



pafe 13 






If you think it might rain during the day, you could look out your window 
and try to forecaat from what you see whether it will rain. Which view 
above (A, B or C) would make you moit certain that it would rain? 



45 

When we toes an ordinary balanced coin, it can land either hcada or tails 
(If the poaaibility of atanding on edge ia eliminated) . Therefore, the number 
°f all p oaalble eventa on a aingle toaa (trial) of a coin ia two (heada or taila). 



In P {a} 
of a coin). 



1L 

N 



N * 



, (the number of all poaaible eventa on a toaa 



64 

Two glrla and 3 boya are in a room. To calculate the probability that a 
blindfolded peraon will firat chooae a girl, then chooae a boy, we must know 
if the firat peraon choaen will remain (be replaced) in the group or aent out 
of the room. A « girl, B « boy. If the firat peraon is replaced in the group, 
then 

2 w 3 # However, if the first 



P {ab} - P {a} P {b}-| X 






FH* M 



123 

The probability* were repreeented at aome fractional value, generally 
obtainable by dividing n by N. The values of n and N are not alwaya eaay 
to find by simple counting procedures. Two computational methods used 
in finding the values of n and N are PERMUTATIONS and COMBINATIONS. 

The distinction between ______ and combinationa depends 

upon whether or not the thing we aro intereated in has distinguishable 
ORDEREp arrangements. 



\ 



,.r Him, ihiiiu wuulU l>t< J nuIiui »u|>n, und MUt>K roup woutu h.vu 

member, because there ia only 1 (a), l (b) and 1 (c). Thus. 



n! 



(3) (2) (1) 

TiTTimr 



• 


B 


45 


2 


64 


4 


123 






par mutations 


6 
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4. SAMPLE FROM: PROGRAMMED TEXT NO RESPONSE 



page 7 




You would be certain that the hammer blow would not break the tough 
steel rod. 






44 

I Let a trial be a single toss of a coin. There is only one head on a coin. 

I Therefore, there is only one possible occurrence of heads. If A * heads, 

I thus, in 

p W ‘IT- “a* 1 




I 83 

/ In C4i««0 like flipping a coin or rolling a die* replacement U not a proHlaw** 

/ it haa already been taken earo of* The Head and tail remain on a coin* ***** 

/ ell the mix numbers on a die remain on the die. However, 

/ oan be removed In a trial, we must oonelder whether or not that eome»iu»a 

/ will be replaced before the next trial. 




1 122 

So far you have studied about the probability of a single event, P {a} ; the 
probability of either one or another of two or more possible events, 

1 P iA or b} ; the probability of joint events, P { AB} ; and the probability of 

the union of events, P { AUb}, that is, the probability of either A or B 
occurring when it is possible for both A and B to occur in the same trial* 


ISl ui-fc . -r-Tf M* mmmtrn wwrrf 

\ :s»«j8Ms-»Br c: ssssu=scs.*!=r — 

\ ^ p*rmut.«lo« - Si 11 it rr - 

The different permutations of the letters In the word PAPAL are: 

2! 2! 1! 30 
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If you think it might rain during the day, you could look out your window 
and try to forecast from what you see whether it will rain. View B would 
make you most certain that it would rain. 



45 



When we toss an ordinary balanced coin, it can land either he ads or tails 



(if the possibility of standing on edge is eliminated). Therefore, the 
number of jUl possible events on a single toss (trial) of a coin is two (heads 
or tails). 

n. 

In P {a} * — — . N = 2. 



N 



84 



Two girls and 3 boys are in a room. To calculate the probability that a 
blindfolded person will first choose a girl, then choose a hoy, we must know 
if the first person chosen will remain (be replaced) in the group or sent out 
of the room. A - girl, B = boy. If the first person chosen is replaced in 
the group, then 



P (ab) rn P {a} p { 33 } • \ * "g* * 31 



P*rwcm 



**•«»«»*»%* 



iw want «»ut nr * *»<v 
«h*w 



* How*v*r, If iH* 

miy 41 *»«o «*«on« would %»«» ***** 



{^»} " » 



\ 



123 



The probabilities were represented as some fractional value, generally 
obtainable by dividing n by N. The values of n and N are not always easy 
to ?tnd by simple counting procedures. Two computational methods used 
in finding the values of n and N are PERMUTATIONS and COMBINATIONS. 
The distinction between permutations and combinations depends upon 
whether or not the thing we are interested In has distinguishable ORDERED 
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5. TRANSCRIPTION FROM PROGRAMMED LECTURE - T 



Let’s say we have three events, ABC, three things, it does 
not matter, just ABC* We can handle it because we are 
engineers with high mathematical knowledge* We have A, B, 
and C and we are interested in how many ordered sequences 
of A, B and C we can get. Let’s say we have three bins and 
we are making choices for what goes into our bins. How many 
choices do we have if we are throwing these things in. How 
many choices do we have for the first bin? (Response. Three. ) 
Second? (Response. Two.) Third? (Response - only one left.) 
If we are interested in the number of ordered sequences of A, 
B, and C, we multiply these and get six. But let me explain 
this in a different way that makes more sense; where the six 
comes from. We have. A, B, and C again, and we are in- 
terested in ordered sequences. We want to choose a letter 
or an event to come after A where we have a choice of B 
here, C here; same way B here, C here; A here, B here. 

OK? Coming out with this now we only have one choice 
which is iike this. ( ) OK. Now each one of these is an 
ordered sequence, and if we count up the number of ordered 
sequences we obviously have three, six rather. Now each 
one of these ordered sequences I call a permutation of the 
events. The events are all individually identifiable, I can 
tell A from B from C. But I’m interested in how many ways 
can I arrange them, and 1 get six. And the number six I 
found (I make up this way) going into generalities. Let's 
say I have n events — all distinguishable, (if that’s how you 
spell distinguishable), I found out that what I did was going- 
back to this for a simple minded procedure -- was first put 



Blackboard Work 
ABC 



I II ILJ 



A 

B 




= 6 



A 


B 


C 


A 

/\ 
B C 


B 

/\ 
A C 


C 

i\ 


A 


A 


A 


b ' c 
/ \ 

C B 


f 9 

C A 


B A 
# \ 

A 1 


1 2 


3 4 


5 6 



3 x 2 x 1 = 6 
n events 



3 
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5. TRANSCRIPTION FROM PROGRAMMED LECTURE - T 



1 



Let’s say we have three events, ABC, three things, it does 
not matter, just ABC. We can handle it because we are 
engineers with high mathematical knowledge. We have A, B, 
and C andi we are interested in how many ordered sequences 
of A, B and C we can get. Let's say we have three bins and 
we are making choices for what goes into our bins. How many 
choices do we have if we are throwing these things in. How 
many choices do we have for the first bin? (Response. Three.) 
Second? (Response. Two.) Third? (Response - only one left.) 
If we are interested in the number of ordered sequences of A, 
B, and C, we multiply these and get six. But let me explain 
this in a different way that makes more sense; where the six 
comes from. We have. A, B, and C again, and we are in- 
terested in ordered sequences. We want to choose a letter 
or an event to come after A where we have a choice of B 
here, C here; same way B here, C here; A here, B here. 

OK? Coming out with this now we only have one choice 
which is iike this. ( ) OK. Now each one of these is an 
ordered sequence, and if we count up the number of ordered 
sequences we obviously have three, six rather. Now each 
one of these ordered sequences I call a permutation of the 
events. . The events are all individually identifiable, I can 
tell A from B from C. But I'm interested in how many ways 
can I arrange them, and I get six. And the number six I 
found (I make up this way) going into generalities. Let's 
say I have n events — all distinguishable, (if that's how you 
spell distinguishable), I found out that what I did was going- 
back to this for a simple minded procedure — was first put 



Blackboard Work 
ABC 



I I I ILJ 




= 6 



A 

/\ 

B C 



B 

1 \ 



C 

/\ 

B A 



b A c 



B C 



2 3 



A 



X A 



A 



3 x 2 x 1 = 6 
n events 




28 
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down n, the number of ways I can fill the first block. The next 
number I put down was n - 1, number of ways I could fill the 
second block. And then put down n - 2, and so on, I would have 
gone on had I more. And, putting in dots for what I am leaving 
out, I finally would have gotten down to 1. I then would have 
multiplied all these things out together and I would have gotten 
the number of permutations. We have a shorthand for this and 
we say that this sequence of operations is equivalent to writing 
n with an exclamation point over it which means n factorial. 

This notation is familiar? uiifamiliar? If it’s unfamiliar I'm 
happy because you have learned something. So n factorial we 
associate with the number of permutations of distinguishable 
things. Let's say we have the first five numbers in the Arabic 
number system: How many ways can we arrange the first five 
numbers ? By factorial computation: five times 4 and so on. 
How many? (Response - one hundred and twenty. ) OK. 

That's not so great. Actually as you go up in number, this 
number starts getting real big. This is a type of a problem 
that you have in assigning license plates. Let's say you only 
wanted to assign numbers on license plates, how many num- 
bers would you have to assign so that everyone in the state 
could have a license number? Well you go to letters in big 
states like California because you have more choices of ways 
to fill the first block. Right? But you don't use all twenty 
six letters and this we will get to later. Anyway, the permu*; 
tations, this is all the permutations, all the ordered com- 
binations we can make -out of five events. Another example, 
let's say we have a rat facing a maze and we have three 

doors (this is door 1, door 2, and door 3) and he can go ^ 

through two tunnels (tunnel 1 and tunnel 3) that he can get 

in the apparatus and three exits (exit 1, exit 2, exit 3) that 

♦ 

he can leave through. What's the estimate of the number of 
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paths he has through this maze ? (Response - Eighteen. ) OK. 
How do we get it? Three doors — think of our little tree that 
comes out — now from each of these three doors. We can go 
through any one of the two tunnels . He has gone this far, he 
has had six choices. He can leave through any one of these 
three exits, which multiplies this by three, with a grand total 
of eighteen paths through the maze. Just like considering the 
ordered sequence of events -- how many ways can you fill the 
first one, times how many ways can you fill the second one; 
times how many ways can you fill the third one. OK. How 
many permutations of the alphabet are there ? Quick, just a 
number. (Response - twenty-six factorial) That answers it. 
N'obody in their right mind would expect you to multiply it 
out. You use the shorthand for something like this. ( ). 

On to the next problem. Let’s say that permutations then of 
n distinguishable things equal what? (Response - n!) OK. 

The question now is what if we have n things but they are 
broken up into groups so that we can’t distinguish some of 
them. 
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6. TRANSCRIPTION FROM PROGRAMMED LECTURE - T g 

The difference between a permutation and a combination is 
that in the permutation the order of the arrangement of what 
we are looking at is important. In a combination we don't 
care about the order. Let me give you an example, supposing 
I have the three letters A, B, C and I want to know all the 
different ordered arrangements that you can make with this. 
Well you could write A, B, C; A, C, B or you could write 
B, A, C; Bj C, A, C , A, B, or C, B, A. Each one of these 
is a separate permutation of the three letters A, B, C. But 
there is only one combination of the letters A, B, C. To 
clarify this, suppose you have the letters A, B, C, D and I 
wanted to take three of them at a time. I could write A, B, C; 
A, B,D, or B, C, D and A, C, D. They are four combinations 
now. How many permutations of the three letters ? Well, 
quite a few. You see there is a problem in calculating these 
things. Well, let's go about calculating some of these things, 
to illustrate the difference between a permutation and a com- 
bination. I said that in permutations the order is important 
and let's take an example of how we might develop a formula 
for permutations. Supposing I had three ceils here and I 
have three balls. This is the same as those three letters we 
were looking at before. In how many ways can I fill cell one? 
(Response - Three). In other words I could either put an A 
there, a B there, or a C. If I filled it with an A then only B 
and C would remain. Right ? How many ways would I be 
able to fill the second cell? (Response - Two). Supposing I 
filled it with a B; A and C would remain. How many ways 
could I fill it? (Response - Two). Still two, so it doesn't 
make any difference which one you choose first. How many 
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ways would remain then after filling the first and second cells 
for filling the third cell? One way. So 3 x 2 x 1 = 6, and we 
recall that those were the number of permutations for the 
letters A, B, C. If I had four cells and four things to put into 
it I would have 4 x 3 x 2 x 1 and we would have had 24, and so 
on. This suggests then a way of writing permutations. Sup- 
pose we have n things, we could say the permutation of n 
things is equal to (n)(n - l)(n - 2)...., on down the line till 
the last one would be a 1. That’s pretty simple. Supposing 
I had eight things; eight letters of the alphabet; eight different 
letters of the alphabet. Don’t forget n has to be different 
things to distinguish one from the other. Supposing I have 
eight letters of the alphabet, or better yet, eight boys in a 
room and I want to find out how many ways I could arrange 
these eight boys in these eight chairs in the front row. How 
many different ways would there be? Response - (8) (7) (6) (5) 
(4) (3) (2) (1). OK, somebody with a slide rule figure it out, 
we’re not interested. This is a little bit long to write and we 
have a sign for abbreviating it called n factorial. There is 
nothing magic about the word factorial. In multiplication each 
one of these numbers in the parentheses is a factor, and the 
whole thing of them is called n factorial. I mentioned a minute 
ago though that if some of them were indistinguishable then this 
formula might not hold up. For example, supposing we have 
the letters A, A, B, C. Well, we can’t distinguish between one 
A and the other A. 
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7. TRANSCRIPTION FROM STANDARD LECTURE - Tg 

Now we should move Into the next area of permutations . We 
have discussed in the past combinations. Now we discuss permu- 
tations. Now permutations are merely arrangements, rather 
than just total groups. The number of arrangements in a set are 
called its permutations. Now if I've got three people up here and 
I want to take their picture. Do I want George, Henry, and Bill, 
or do I want Bill, Henry, and George or do I want Henry, Bill 
and George ? How many different arrangements can I make 
with these three people? Let's take this simple example, I'm 
not satisfied, one's a little taller than the other, and I don't 
know whether I want one head here, and one here, and one here, 
or this way, or that way. I don't know how I want these people 
so what I've decided to do, I'm going to take all possible com- 
binations of these. Bill, Henry, and. George and now how many 
pictures I'm going to have to take ? (Response - Six) How did 
we get six.. Three people. Right. So that the number of permu- 
tations: Unfortunately it is the same letter but I have, just for 
convenience, used a capital B instead of a script be, but it is a 
different word. The number of permutations here is n - factorial, 
and you have all used factorials in the past. The expression n- 
factorial is just (n)(n - l)(n - 2)(n - 3).. .. and so on (2)(1) etc. 

So six factorial would be (6)(5)(4)(3)(2)(1). One factorial? 
(Response - One). Zero factorial? (Response - One) Watch 
this, you get in trouble if you don't. This will save us. You 
told me that factorial three equals three times two times one, 
and that equals six. Anyhow we will still be in trouble. Now 
the number of arrangements of a set are called its permutations. 
Is that right ? Since we 've got a few equations here, to think 
about, we 'll just write B equals n factorial. Now let's carry 
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it one step further, what are the permutations of n objects; given 
number of objects, but we are only going to take a few of them 
at a time? We’ve got six objects, I’ve got six cards, well, let’s 
not use that example# Let’s go back to the thre& people we were 
taking pictures of. I want to take two of them at a time. The 
number of arrangements of pictures of two of these three people. 
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8. CRITERION TEST 



Instructions: 

Use formulas as you learned them today* even though you 
may know other ways to express the same concept* 

Fill in the missing answers for the completion-type ques- 
tions. Example: Honey is sweet ♦ 

The possible answers for multiple -choice -type questions 
are given inside brackets. Circl e the c orrect answer. 

Example: Honey is (bitter: old: C gwee^ ). 

1. The degree of certainty one has is usually related to the amount of relevant 

one has accumulated concerning the problem under 

consideration. 

2. The degree of certainty one has concerning the occurrence of events can 
be used in (interpreting the problem: forming a probability scale: de- 
termining the accuracy of the measurements: ascertaining the number of 
trials needed for a given event: choosing the correct odds in a bet). 

3. If all the elements of a problem can be stated with accuracy and certainty, 

the problem is called > and we would have no uncertainty 

about the solution. 

4. If a three volume set of books is placed on a shelf by a blind man* what is 
the probability that they will be in the correct order, i.e.* Vol I - Vol II - 
VolIH? (1/3: 1/6: 1/9: 1/2: 2/3). 

5. The denominator in problem four represents the number of (permutations: 
additive ways: trials: combinations: probabilities). 

6. An urn contains three white balls and two black ones. If two balls are 
drawn without replacement* what is the probability that both will be white: 

(a) Write the formula 

(b) Show the calculations 

7. If you are given the five digits 2. 3, 4* 7, 8* how many different three- 
digit numbers could you form: 

(a) Write the formula 

(b) Show the calculations 

8. How many different three-man committees can be chosen from nine men:? 

(a) Write the formula 

(b) Show the calculations 

9. The probability of an adult winning a certain contest is 0.05 and the prob- 
ability of a child winning the same contest is 0.01. If both a father and son 
enter the same contest* what is the probability that some one in the family 
will win the only prize ? 
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10. A box contains 7 red beads and 3 white beads. How many different neck- 
lace patterns could be made with these beads? (45: 90; 120; 35: 210), 

11. If you simultaneously flipped a coin and rolled a die, what is the prob- 
ability of getting either a head on the coin or a (3 on the die, but not 
necessarily both? 

(a) Give the formula 

(b) Show the calculations 

What is the probability of seeing either an ace or a king in one draw fron* 
a deck of 52 cards? (1/26: 2/13: 400/2704: 16/2704: 1/52) 

13. In an 8-t.eam league, every team plays each other team 10 times. How 
many games are played? Show your calculations. 

14. A marksman has shot at a target twice on each of 4 days. On the first 
shot he hit the target once in four days. On the second shot he hit the 
target twice in four days. The next day out, what is the probability 
that he will hit the target at least once on either the first or second shot, 
assuming that his aim has not improved? 

15. If on a menu there are six main courses to choose from, and four des- 
serts to choose from, but the choice of a dessert will be influenced by 
what is chosen for a main course, we say the choices are not (mutually 
exclusive: exclusive: independent: deterministic: probabilistic). 

16. Six dice are tossed. What is the probability that a different number will 
show up on each die? 

17. A military commander wants to relay a message from Zimbo to Dimbo* 



ZIMBO 



There are two routes and he decides to send a messenger via each route. 
One route leads through a forest and a river ford. There is only 6/10 
chance that a messenger could survive passing through the forest and 
only 8/10 chance he could survive the river ford. The other route leads 
through a plain and across a bridge. There is only a 1/2 chance that a 
messenger could survive crossing the plain and a 9/10 chance that he 
survives crossing the bridge. What is the probability that the message 
will get through? Show calculations. 

18. If you are given a penny, a nickel, a dime, a quarter, a half dollar, and 
a silver dollar, to find how many different sums of money could be formed 
from these six coins, you would (calculate the permutations: add the 
various permutations: add the various combinations: multiply the various 
permutations: multiply the various combinations). 
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19. A satellite radio transmitter will operate on any one of two tubes hooked 
into the transmitter circuit. Let event A be failure of one tube, and 
event B be the failure of the other tube. There are two identical trans- 
mitters in the satellite, each with two tubes. Show the formula you would 
use to calculate the probability that a message would be transmitted, 

20. If the first stage of a three stage missile has a »8 probability of func- 
tioning properly, and the second stage has a * 8 probability of functioning 
properly, and the third stage has two rockets, each with a .6 prob- 
ability of functioning properly, but either one of which can push the 
third stage into orbit, what is the probability that the missile will orbit 
successfully? 



Instructions: When you finish answering these questions please 
call the instructor. 
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9. SUBJECTIVE QUESTIONNAIRE ON AUTOMATED METHOD 



DEPARTMENT OF ENGINEERING 
UNIVERSITY OF CALIFORNIA 
LOS ANGELES 



Directions to students: 



This form will allow you to evaluate the instruction which you have 
just had. Please check (<S) at the point on each scale where you think the 
instruction belongs. Do not sign your name to this form. 



1. Were the purposes of the instruction 
clearly recognizable ? 



rnrnrnrn 

unclear clear 



2. How satisfactory was the organization 
of the subject matter ? 

3. Were explanations clearly presented? 



r i i ! i 1 1 1 1 i 

well poorly 

organized organized 

i — 1 1 — 1 1 — 1 1 — 1 1 — i 

always never 



4. 

5. 

6 . 

7, 



9. 

10. 



li. 



12 . 



Were there an adequate number of 
explanations ? 

How difficult was the subject matter ? 

Do you feel confident that you know the 
material covered? 

How did you like this method of in- 
struction as compared to a lecture ? 

How much do you feel you learned as 
ci npared to a lecture ? 

How well did you understand the subject 
matter as compared to a lecture ? 

Did you like or dislike the environment 
in which you were receiving the in- 
struction ? 

Do you prefer working at your own pace 
as you did here ? 

Please add any additional comments you 



mrnrnrni i 

plenty too few 



4 



i 1 1 1 1 1 1 1 1 i 

too hard too easy 

i 1 1 1 1 1 1 1 1 i 

confident not confident 



I I I II II U ) 



dislike 



like very much 



i 1 1 1 1 1 1 ii i 

much more much less 

I I I II II II I 

poorly better 

nnnnn 

like dislike 

Jyes or no) 

have regarding the instruction. 
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10. SUBJECTIVE QUESTIONNAIRE ON LECTURE METHOD 



DEPARTMENT OP ENGINEERING 
UNIVERSITY OF CALIFORNIA 
LOS ANGELES 



Directions to students: 



This form will allow you to evaluate the instruction which you have 
just had. Please check ( t/) at the point on each scale where you think 
the instruction belongs. Do not sign your name to this form. 



1. Were the purposes of the instruc 
tion clearly recognizable? 



r~i n m r~i r~i 

unclear clear 



2. How satisfactory was the organiza- 
tion of the subject matter? 

3. Were explanations clearly presented? 

4. Were there an adequate number of 
explanations ? 



mrnnmn 

well poorly 

organi zed o rgan ized 

r~i i ii 1 1 1 1 i 

always never 

nnnnn 

plenty too few 



5. How difficult was the subject 
matter? 

6. Do you feel confident that you 
know the material covered? 



r~i r~i r~i n r~i 

too hard too easy 

□nnnn 

confident not confident 



7. How extensive is the instructor's 
knowledge of the subject? 



i — 1 1 — 1 1 — 1 1 — 1 1 — t 

inadequate extensive 



8. What is your general estimation 
of this instructor as a teacher? 



r~i i — ii — ii — 1 1 — i 

superior inferior 



Please add any additional comments you have regarding the instruction. 
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57 
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48 


- 


49 
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- 


43 
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47 
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- 
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58 
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31 
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* 


66 


155 
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9 

11 
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13 
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4 


169 


75 


• 


37 


14 


PTNR 


3 


170 


175 


- 


30 


12 


FRMB 


2 


170 


152 


- 


39 


13 


FRMB 


3 


170 


ICS 


~ 


73 


15 


FRMC 


2 


170 


97 


- 


43 


10 


PTNR 


1 


170 


165 


- 


42 


9 


FRMC 


3 


171 


115 


- 


41 


11 


FRMC 


4 


171 


80 


- 


41 


17 


PTNR 


4 


171 


48 


- 


41 


13 


T 3 


- 


171 


72 


- 


67 


17 


t 2 


- 


172 


116 


~ 


43 


7 


PTNR 


3 


172 


88 


• 


43 


19 


Tl 


- 


172 


125 


- 


34 


21 


FRMC 


2 


172 


141 


• 


34 


8 


FRMB 


3 


173 


88 


- 


56 


13 


Tl 


- 


173 


104 


16 


40 


14 


PTR 


3 


173 


111 


- ■ 


64 


15 


PTNR 


3 


174 


72 


- 


84 


10 


t 2 


- 


175 


138 


- 


27 


9 


FRMC 


4 


176 


148 


- 


22 


5 


FRMC 


0 


177 


88 


- 


36 


21 


T X 


- 


177 


88 


• 


65 


20 


Tl 


- 


177 


125 


- 


37 


16 


FRMB 


1 
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Name 



1. DATA SHEET (CONT'D) 



LDEE 


Learning 


Learning 


Criterion 


Criterion 


Teaching 




Time 


Error Score 


Test Time 


Test Score 


Method 


177 


92 


_ 


65 


19 


PTNR 


177 


72 


- 


46 


19 


T 2 


178 


56 


- 


53 


21 


PTNR 


178 


87 


- 


68 


13 


PTNR 


179 


185 


- 


40 


16 


FRMB 


180 


88 


- 


33 


17 


T 1 


180 


143 


19 


44 


17 


PTR 


181 


48 


- 


44 


12 


t 3 


181 


123 


29 


56 


14 


MCM 


182 


143 


- 


72 


17 


FRMB 


182 


102 


40 


88 


21 


MCM 


182 


103 


11 


40 


16 


PTR 


182 


48 


- 


40 


11 


T 3 


182 


48 


- 


81 


16 


t 3 


183 


72 


- 


74 


14 


t 2 


183 


131 


12 


48 


14 


PTR 


183 


88 


- 


54 


14 


T 1 


184 


132 


28 


38 


12 


MCM 


184 


74 


- 


46 


21 


PTNR 


184 


94 


- 


52 


14 


PTNR 


185 


83 


- 


48 


. 15 


Tl 


185 


72 


- 


48 


14 


t 2 


185 


111 


- 


53 


10. 


PTR 


185 


112 


15 


53 


10 


PTR 


186 


91 


14 


44 


22 


PTR 


187 


132 


- 


35 


13 


FRMC 


187 


160 


- 


30 


19 


FRMC 


189 


86 


- 


50 


11 


PTNR 


189 


122 


- 


37 


22 


FRMB 


190 


105 




46 


16 


FRMC 


190 


118 


34 


50 


20 


PTR 


190 


ICO 


16 


36 


17 


MCM 


193 


68 


- 


76 


19 


PTNR 


193 


88 


- 


66 


18 




4 3 
x95 


48 

174 




51 

36 


17 

13 


T 1 

fImc 


198 


72 


- 


64 


15 


t 2 


199 


76 


- 


30 


11 


PTNR 


204 


102 


- 


60 


20 


PTNR 


210 


76 


10 


71 


22 


MCM 


? t 


93 




59 


11 


PTNR 


? t 


99 


21 


56 


21 


PTR 


? t 


133 


41 


31 


11 


PTR 


154 


166* 


- 


- 


- 


FRMB 


143 


235* 


- 


- 


- 


FRMB 



Liking 

Rating 

2 

4 

2 

3 

3 

1 

1 

4 
4 



3 

3 

4 
4 



0 

4 

1 

3 

4 

3 

4 
2 
2 
4 
2 



1 

4 

2 

2 

1 

1 

3 



* Student did not finish task, 
t Discarded samples. 

♦♦Student did not take criterion test. 
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2. CRITERION TEST SCORES (x) AND LEARNING TIME (y) 
BY TEACHING METHOD AND APTITUDE QUARTERS 



Quarters 

by 

LDEE 


Multiple 

Choice 

Machine 

(HCV' 


Free Response 
Machint 
Classroom 

(FRMC) 


rraa Response 
Hachlna 
loot hi 

(FRMB) 


Programed 
Taxi, with T 

Response* 

(PTR) 


Profiraaead 
•xt* no overt 
Responses 

(PWR) 


PrOftfMKd 

Lecturer 

(h> 


Programmed 

lecturer 

(T 2 ) 


Standard 

Lecturer 

(T 3 ) 


Cotuen Row Keane 
‘Standard 
Oaviatlona 




y 


X 


y 


X 


y 


X 


y 


X 


y 


X 


y 


X 


y 


X 


y 


X 


y\U 


X 




86 


14 


164 


- 


228 


- 


112 


4 


114 


16 


88 


10 


72 


10 


48 


8 








122 


13 


172 


5 


221 


11 


188 


13 


93 


12 


88 


11 


72 


13 


48 


11 








170 


9 


148 


9 


161 


4 


168 


5 


111 


9 


88 


17 


72 


16 


48 


8 


143 


11.1 




118 


18 


129 


12 


177 


8 


123 


16 


114 


4 


88 


10 


72 


6 


48 


13 






Q i 






145 


14 






154 


- 


107 


23 


88 


13 






48 


9 










140 


15 






107 


15 


106 


14 














37* 


3.7* 








150 


12 










83 


15 
























197 


- 




































154 


- 




































168 


8 
































116 


6 


142 


14 


154 


11 


131 


7 


105 


14 


88 


11 


72 


13 


48 


8 








112 


7 


176 


- 


130 


9 


108 


16 


115 


10 


88 


14 


72 


11 


48 


6 








122 


9 


178 


19 


149 


- 


112 


16 


104 


14 


88 


16 


72 


9 


48 


9 








149 


12 


183 


- 


165 


18 


115 


17 


103 


11 


88 


10 


72 


13 


48 


13 


130 


12.3 








110 


13 






114 


8 


99 


15 






72 


13 


48 


10 










143 


18 






148 


- 


79 


16 














34* 


3.8* 








195 


14 






107 


14 


87 


14 
























171 


19 






113 


9 
























125 


10 


140 


10 


200 


11 


103 


16 


100 


14 


88 


17 


72 


14 


48 


10 








130 


14 


187 


17 


126 


17 


126 


11 


81 


14 


88 


16 


72 


Id 


48 


11 








92 


12 


167 


14 


109 


17 


132 


19 


80 


15 


88 


16 


72 


17 


48 


7 












156 


15 


175 


12 


99 


17 


72 


7 


88 


19 


72 


10 


48 


10 


122 


13.4 


Q 3 






165 


9 


152 


13 


112 


11 


75 


14 


88 


13 






48 


13 












115 


11 


141 


3 


108 


14 


97 


10 














33* 


3.5* 








125 


21 






104 


14 


80 


17 




































116 


7 




































111 


15 




















123 


14 


138 


9 


125 


16 


143 


17 


92 


19 


88 


21 


72 


19 


48 


12 








102 


21 


148 


5 


185 


18 


103 


16 


56 


21 


88 


20 


72 


14 


48 


11 








132 


12 


132 


13 


143 


17 


131 


14 


87 


13 


88 


17 


72 


14 


48 


16 








100 


17 


160 


19 


12Z 


22 


111 


10 


74 


21 


88 


14 


72 


15 


48 


17 


113 


15.9 


Q 4 


76 


22 


105 


16 






112 


10 


04 


14 


88 


15 




















174 


13 






91 


22 


86 


11 


88 


18 










21* 


3,2* 
















118 


20 


68 


19 




































76 


11 




































102 


20 


















Coluan 

Means 


117 


13.1 


154 


13.: 


2 160 


12*' 


1 121 


13. £ 


j 93 


13.1 


88 


15.{ 


) 72 


13*: 


2 48 


10. £ 


> 127 


13.2 


Standard 
Dav i atiom 


, 23 


4.6 


24 


4.: 


2 31 


4.1 


3 24 


4.5 


5 15 


4.C 


) 0 


3 A 


3 0 


r 


n 


3. 3 


L 34 


4.1 



(1) The row means and standard deviations for learning time do not include the non-vuriant 
student learning time with Tj, T 2 * T g . 

Learning time is in minutes* 

Maximum possible criterion test score: 23. 
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3. RESULTS OF TEST OF HYPOTHESES 

A. Hypotheses that the mean performances of students (as measured by 
criterion test scores) are equal if the students are taught by the following 
methods: 



X. MCM vs. FRMC vs. FRMB vs.PTR vs. 
PTNR vs. T. vs. Tg vs. Tg. 


F 


D.F. 


Significance 
at at a s Q, 05 


1. 80 


7 


140 


~ 0, 10 


NS 


2. FRMC vs. FRMB 


0, 11 


1 


34 


- 0.75 


NS 


3. MCM vs. (FRMC & FRMB) 


0. 16 


1 


50 


~ 0.70 


NS 


4. PTR vs. PTNR 


0. 08 


1 


50 


- 0.80 


NS 


5. (MCM & FRMC & FRMB) vs. (PTR & 
PTNR) 


0. 15 


1 


108 


~ 0.70 


NS 


6. T x vs. T 2 


1.98 


1 


29 


~ 0.18 


NS 


7. (MCM & FRMC & FRMB & PTR & PTNR) 
vs. ( T a & T 2 ) 


1. 14 


1 


145 


~ 0.25 


NS 


8. (T x fe T 2 ) vs. Tg 


18.43 


1 


48 


< 0.0005 


S 


9. (MCM & FRMC & FRMB & PTR & PTNR) 
vs - T 3 


6.89 


1 


127 


0.01 


S 



B. Hypotheses that the mean performances of students (as measured by 
criterion test scores) are equal if compared according to the following apti- 
tude quarters: 



1. Qj vs. Q 2 vs. Q 3 vs. Q 4 


14. 08 


3 


140 


< 0.0005 


s 


2. Q 1 vs. Q 2 


2. 13 


1 


65 


~ 0. IP 


NS 


3. Q 2 vs. Q 3 


3. 17 


1 


71 


- 0.08 


NS 


4. Q 3 vs. Q 4 


9.80 


1 


75 


~ 0.003 


S 



C. Hypotheses that the mean performances of students (as measured by 
criterion test scores) are equal if compared according to teaching methods 
and aptitudes (interactions) as follows: 



1. All teaching methods and four quarters 


1.43 


21 


140 


~ 0.10 


NS 


2. Machines vs. Programmed textbooks 
and four quarters 


0. 03 


3 


108 


~ 0.99 


NS 

l 



ERIC 
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F 


D.F. 


Significance 
at at a=0. 05 


Auto-instruction vs. Programmed 
lectures and four quarters 


0.73 


3 


145 


~ 0. 98 


NS 


Programmed lectures vs. Standard 
lectures and four quarters 


0. 95 


3 


48 


- 0.40 


NS 


Auto-instruction vs. Standard lectures 
and four quarters 


0,36 

\ 


3 


127 


- 0.85 


NS 



D. Hypotheses that the mean learning times o f students are equal if the 
students are taught by the following methods: 



E. Hypotheses that the mean learning times of students are equal if com- 
pared according to the following aptitude quarters: 

1. ^ vs. Q 2 vs. Q 3 vs. Q 4 

2. Q 2 vs. Q 2 

3. Q 2 vs. Q 3 

4. Q 3 vs. Q 4 

F. Hypothesis that the mean learning times of students are equal if com- 
pared according to teaching methods and aptitudes (interactions): 



1, All teaching methods and four quarters 



1.01 



12 



105 



~ 0.50 



NS 



i I 



1. 


MCM vb. FRMC vs. FRMB va. PTR vs. 


40.47 


4 


105 


< 


0. 0005 


s 




PTNR vs. T, vs. T 2 vs. Tg. 














2. 


FRMC vs. FRMB 


3.38 


3 


41 




0.025 


s 


3. 


PTR vs. PTNR 


41.11 


1 


52 


< 


0. 0005 


s 


4. 


MCM vs. FRMC 


21.83 


1 


39 


< 


0. 0005 


s 


5. 


MCM vs. PTR 


0.39 


1 


36 


< 


0.60 


NS 



7.77 


3 


105 


< 


0.0005 


S 


2.30 


1 


52 




0. 15 


NS 


0.02 


1 


53 




0. 93 


NS 


0.12 


1 


53 


fSJ 


0.91 


NS 
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APPENDIX C 

4. LINEAR RELATIONSHIPS OF VARIABLES 



Correlation Coefficients, 2 Variables: 

r 

1. LDEE and Criterion Test Time, All teaching Methods . 026 

2. LDEE and Criterion Test Time, AU machines & texts . 114 

3. LDEE and Criterion Test Score, All teaching Methods . 468 

4. LDEE and Criterion Test Score, All machines & texts . 454 

5. LDEE and Learning Time, All machines & texts - ,290 

6. Learning Time and Criterion Test Time, All machines 

and texts - . 389 

7. Learning Time and Criterion Test Score, All machines 

and texts - .250 

8. Criterion Test Time and Criterion Test Score, All 

teaching Methods ,168 

9. Criterion Test Time and Criterion Test Score, All 

machines & texts .314 



Multiple Correlation Coefficients, 4 Variables: 

~~ ~ _ R 

1. Criterion Test Scores on LDEE, Learning Times and 



Criterion Test Times .526 

2. Learning Time on LDEE, Criterion Test Time and 

Criterion Test Score . 462 

3. Criterion Test Time on LDEE, Learning Time and 

Criterion Test Score .460 

4. LDEE on Learning Time, Test Time, and Criterion 

Test Score , 499 



Multiple Correlation Coefficients, 3 Variables: 

R 

1. Criterion Test Score on LDEE & Criterion Test 

Time, All Methods ,493 

2. Criterion Test Score on LDEE & Criterion Test 

Time, All Machines and texts .526 

3. LDEE on Criterion Test Time, Criterion Test 

Score, All Methods .471 



ERIC 



at <*=.01 



n.s. 



n.s. 

sig- 

sig. 

sig. 

sig.„ 



sigy 



n.s. 



sig. 
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R 

4. LDEE on Criterion Test Time & Criterion Test 

Score, All Machines and Texts . 455 

5c Criterion Test Time on LDEE and Learning Time, 

All Machines and Texts . 389 

6. Criterion Test Score on LDEE and Learning Time, 

All Machines and Texts .471 

7. Learning Time on LDEE and Criterion Test Time, 

All Machines and Texts .461 

8. LDEE on Learning Time and Criterion Test Score, 

All Machines and Texts • 489 

9. Criterion Test Time on Learning Time and Criterion 

Test Score, All Machines and Texts . 449 

10. LDEE on Learning Time and Criterion Test Time, 

All Machines and Texts .290 

11. Criterion Test Score on Learning Time and 

Criterion Test Time, All Machines and Texts .344 

12. Learning Time on LDEE and Criterion Test Score, 

All Machines and Texts .319 

13. Criterion Test Time on LDEE and Criterion Test 

Score, All Methods .178 

14. Criterion Test Time on LDEE and Criterion Test 

Score, All Machines and Texts .316 

15. Learning Time on Criterion Test Time and Criterion 

Test Score, All Machines and Texts .412 



Liking vs. Criterion Test Scores 



A study of liking ratings and criterion test scores failed to show a 
significant linear relationship between these two measurements for all 
machine and text methods together, as well as for each method separately. 
For all methods there were relatively few students who gave 0 or 1 liking 
^ratings . How a student felt towards a particular method did not seem to be 
related to how well he did on the criterion test. 

Liking vs. LDEE 

Similarly, analyses of liking ratings and LDEE did not 
lationship either for the individual methods or for all machine 



show any re- 
and text methods 









taken together. There was a wide variability in the liking rating for any 
given LDEE score. Apparently the liking or disliking of any particular 
method is not influenced by the ability of the student, as measured by LDEE 
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APPENDIX D 



1. LEARNING TIME VS. CRITERION TEST SCORES 




I 



\ 



\ o 
l ERIC 

I 
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CRITERION TEST SCORES 



APPENDIX D 



2, LIKING VS, CRITERION TEST SCORES 



25r 



♦ 





♦ 



5 



f 

V 

fc 



• PTNR 
A FRMB 
■ PTR 

♦ MCM 
▼ FRMC 




j, 

I 



J 

2 

LIKING RATING 



-L 

3 



J 

4 
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APPENDIX E 

OBSERVER'S COMMENTS 
Classroom With Machines 



Observer As 


In general, the students showed serious attitude toward the 
task. During the first fifteen r^nutes they were easily 
distracted by noises In the room, but after thu short period 
most of them settled down. Boredom was evident in a few 
students within one hour after starting to work. Some stu- 
dents were frustrated by small difficulties in operating 
machines. I was amazed at the ability of these freshmen 
students to concentrate on the task. 


Observer B: 


A student on the multiple-choice machines said that he found 
the machine itself more "fun' 1 than the lesson presented by 
the machine. 

Students who used the free-response machines wriggled and 
fidgeted more than students who used multiple-choice machines. 
One student using a free-response machine claimed it was "too 
boring to turn that crank" • I suggest that students be permitted 
to get up and stretch, smoke, and go for a drink whenever they 
like. 


Observer C: 


Many students asked how many more items there were on the 
program (no indication given to students on how long the lesson 
would be). One student who had only 4 hours of sleep the pre- 
vious night, had difficulty keeping awake and turning 
the handle on the free-response machine. 


Observer D: 


Whenever one student made an error on the multiple -choice 
machine, all the students would hear the "error indicator 
sound" and look up at the other students and smile. 

Some signs of muscular fatigue, yawning, stretching, par- 
ticularly on the free-response machines after two hours on 
the machines. 



Questions about how long the program was, since some stu- 
dents had later classes. 

Classroom With Programmed Textbooks 



Observer E: 


Students using PTNH seemed more serene than students who 
used PTH. Many scowls among later group, some of whom 
looked ahead in the text and also back, apparently to review 
previous items. Also, some of the students using PTH 
looked ahead at the answers before writing their response, 
and some erased their responses after checking with the 
correct answer. 


Observer F: 


Many students were fidgety or sleepy (work started at 8; 00 
AM), Also, it was not clear to some of the students that 
there was no time limit for using the teaching material. 
Some students were also curious about how their criterion 
test scores would affect their course grades. 







APPENDIX F 

STUDENTS COMMENTS 

MCM 

1. This type of Instruction demands the attention of the student. 

2. 1 prefer my algebra text, as I can do only as many samples as I need. 
This method of instruction requires more attention than a lecture, 
therefore the learning process Is faster. 

3. I have personally found It to be confusing. There was a multitude 

of formulas and instructions, and consequently little information was 
retained toward the latter half. I also believe that two hours Is an 
extremely long period for this machine, 

/ 

4. 1 think a red light signal would be more appropriate than a noise In 
' signaling a wrong answer. 

5. Educational for a while. A break was needed so that thoughts could 
be organized. Interest began to lag from time element. 

6. Too long a session with no breaks. Try to absorb too much material 
at once. 

7. I felt that I learned much more than in a lecture. 

8. Prefer time to look over and study notes. Too vast an area was 
covered. 

9. I feel that this is a little more clear than a lecture. I would have liked 
more time. 

FRMC 

1. After the 150th item and a little before, time seemed to drag. 

2. Extremely logical, excellent in scope and coverage. 

3. Would have liked to re-read certain parts before proceeding. 

4. I feel that the quantity of Information was too much to be assimilated 
at one sitting. I think that the material would be grasped better if 

53 
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1/2 - 2/3 of the material was presented. 

5*. When a question is asked, or intended, please make it clear. 

6. The test itself was too long — it contained too many problems. 

7. Very excellent instruction. 

8. It was so long that you become frustrated. Too much at once causes 
confusion later on. 

9. Unique way of learning. Should be used more widely. 

FKMB 

1. Too slow. 

2. Loss of interest occurs rapidly. 

3. Seemed slightly exaggerated. Had trouble holding my interest. Many 
busy work questions. 

4. Good general idea, but the test was too long to effectively hold my 
interest. I feel length could be cut without loss of material. 

5. Since there was no opportunity to review items, I had to furnish my 
own explanations. At times 1 grew tired of working. 

6. I feel that one should be able to read over the material more than 
once. 

7. Too many questions. Waste of time. 

8. The idea is very good, but there should be someone available to 
whom questions could be asked. 

PTR 

1. I, personally, didn’t have time to thoroughly absorb the material 
presented well enough to work these problems correctly. I also feel 
that this method of education is too impersonal. 

2. Much of the material was overly repetitious. I would have liked to 
have skipped over many pages. (Note: high scoring student) 
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3* I didn’t read the preliminary instructions, and I went through the whole 
book reading from top to bottom. (Note: student still scored high ! ) 

4. More time needed. 

i - i 

. J • v ' * * 

5. I feel that this method is excellent as a refresher course, but it cannot 
replace the slower, systematic lecture method for first time learning. 
As a refresher it is better than a lecture. 

6. I would like to have the teaching pamphlet handed back. 

7. There was too much material covered in too short a time. 

8. I didn’t feel as if I was working at my own pace. Knowing that there 
is a quiz to follow, I had to hurry to be sure of doing the quiz. 

9. • Although I did not especially care for this media of learning, a student 

might be able to obtain some value from it if he knows the purpose and 
usefulness before the session begins, 

10. I like this method because you can figure it out for yourself. 

• t 

PTNR 

1. I'd like lectures more than this type of Instruction. I am a foreign 

* ‘ *. ’ 

student and 1 get the lecture much faster. 

2. Pace was too fast at end and slow at first. I had trouble in reading 
the material because I wanted to read down the page instead of at the 
same point on consecutive pages. 

3. Very fine idea. 

4. Perhaps the best advantage to this system is that the person using it 
can refer back to previous material without missing anything in the time 
spent doing so. 

5. Discussion should follow the written lesson. 

6. I think this type of instruction should be widely used. The use of only 
one sentence to a page, the repeating of facts, and the reference to a 



\ 



preceding subject while on a different one made things very clear. 

7, Instruction moved very slowly in places and fast in others. 

8, I believe this booklet should first be read as it was, then there should 
be a discussion period to correct any misinterpretations and to help 
those who could not grasp the material covered. 

9, I think it worked good as long as you give good explanations and ex- • 
amples so the student wouldn’t have any questions about it. Also, 
building up to difficult problems. 

10. Is this a psychology test? It’s a great idea and all, except that after 
a couple of hours of reading the same thing, I get a wee bit bored, 
especially after flipping pages back and forth. 

11. I like the idea of reading a small bit of information on each page and 
then going on to the next page quickly. 

12. The one drawback I find is that if one forgets some part of the instruc- 
tion as he progresses well past it, he will find it hard to look up the 
information which he forgot. 

,13. The lecture led into the material very well. In a very few spots, not 
enough explanation and examples. 

14. This would be a good method to prepare for a lecture or review a 
lecture. 

15. The only thing I dislike is that the freedom to ask questions is removed. 

16. I could have learned the material better if I had more time. 

Well prepared lecture covering dull topics made interesting by well-timed 
jokes and comments. I thought the instructor did an excellent job in 
organizing and presenting topics. 

The lecture was prepared fine but there was too much material presented 
at once. This confused me very much. 
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3. Holds attention of class very well ! Pleasant to listen to ! 

4. The instruction was very clear and presented in a short time what 
would have taken weeks to learn otherwise* 

5. With a night of study, the material presented could be easily assimilated. 




1* Very well presented and interesting* 

2. Too much subject matter all at once. 

3. I can ! t memorize formulas that quickly. 

4. The instruction was slow and many examples were given. 




1. Instructor didn’t seem too clear on some of the pot ;s asked by students* 
I don’t believe the entire test could be taken with the information given 
in the lecture. 

2. I feel you could have had better picked examples of each question. You 
made subject seem simpler than it really was. 

3. The instructor was willing to explain anything unclear, but could have 
pushed the subject to insure understanding. 

4. No time to study notes ! 
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